SlideShare a Scribd company logo
1 of 22
Quantitative Analysis for Managers Regression analysis application Instructor: Prof. MINE AYSEN DOYRAN Student: RecepMaz
Regression analysis Regression analysis includes any techniques for modeling and analyzing several variables, when the focus is on the relationship between a dependent variable and one or more independent variables.  Regression analysis helps one understand how the typical value of the dependent variable changes when any one of the independent variables is varied, while the other independent variables are held fixed.  Regression analysis estimates the conditional expectation of the dependent variable given the independent variables — that is, the average value of the dependent variable when the independent variables are held fixed.
Regression analysis The focus is on a quantile, or other location parameter of the conditional distribution of the dependent variable given the independent variables. In all cases, the estimation target is a function of the independent variables called the regression function.  In regression analysis, it is also of interest to characterize the variation of the dependent variable around the regression function, which can be described by a probability distribution.
Regression analysis Regression analysis is widely used for prediction and forecasting, where its use has substantial overlap with the field of machine learning.  Regression analysis is also used to understand which among the independent variables are related to the dependent variable, and to explore the forms of these relationships.
Regression analysis In restricted circumstances, regression analysis can be used to infer causal relationships between the independent and dependent variables. Simple linear regression models have only two variables Multiple regression models have more variables
Regression models involve the following variables The variable to be predicted is called the dependent variable, Y     Sometimes called the response variable The value of this variable depends on the value of the independent variable, X Sometimes called the explanatory or predictor variable, control variable A regression model relates Y to a function of X
Independent variable Independent variable Dependent variable =                          + Introduction regression models dependent variable, Y independent variable, X A regression model relates Y to a function of X
Testing the Model for Significance If the F-statistic is large, the significance level (P-value) will be low, indicating it is unlikely this would have occurred by chance If P value of F Statistic (Significance F) is smaller than 0.05 (5%), it means that your regression model is statistically significant.
Testing the Model for Significance The best model is a statistically significant model with a high r2 and few variables As more variables are added to the model, the r2-value usually increases For this reason, the adjusted r2 value is often used to determine the usefulness of an additional variable The adjusted r2 takes into account the number of independent variables in the model
Testing the Model for Significance  As the number of variables increases, the adjusted r2 gets smaller unless the increase due to the new variable is large enough to offset the change in k (number of independent variables)
Testing the Model for Significance   In general, if a new variable increases the adjusted r2, it should probably be included in the model In some cases, variables contain duplicate information When two independent variables are correlated, they are said to be collinear When more than two independent variables are correlated, multicollinearity exists When multicollinearity is present, hypothesis tests for the individual coefficients are not valid but the model may still be useful
Hypothesis statement , dependent variable and independent variable  Dependent variable……: Total number of white people between 18 to 64 years Independent variable…: Number of white people below poverty level between 18 to 64 years Hypothesis statement..: Hypothesis statement is that while population of white adult people (18 to 64 years) increases, number of white people between 18 to 64 years who are living below poverty level decrease by the years.
INTERPREATION OF REGRESSION OUTPUTS        R Square R square= 0.024884311=2.5% of variation in total number of white people between 18 to 64 years is explained by  white people below poverty level . This value is indicating weak fitness. I f R square is too high (0,8/0,9…) we will have multicollinearity problem. Which means our variables correlated each other. Fortunately, our R square value is not too high and it is also between 0 and 1.
INTERPREATION OF REGRESSION OUTPUTS       Adjusted R square Adjusted R Square= -0.0834618768434626=-8.3% this value is indicating weak fitness. If the number of observations is small we may obtain a higher value of r square. This can provide a very misleading indicator of goodness of fit. That is why many researchers use adjusted R square value instead. If the adjusted R square value higher than R square value we may face multicollinearity problem. Adjusted R Square=-8.3% < R square=2.5% . We don’t have multicollinearity problem.
INTERPREATION OF REGRESSION OUTPUTS Significance F The most important indicator to analysis regression outputs significance F. This value refers statical significant of regression model. This value provides evidence of existence of a linear relationship between our two variables. It also provides a measure of the total variation explained by the regression relative to the total unexplained variation. The higher the significance F, the better the overall fit of the regression line. Significance F values of 5% (0.05) or less are generally considered statistically significant. Like P values, lower the significant of the value, the more confident we can be of the overall significance of the regression equation.  Interpretation of Significance F is the low number means there is only 64% chance that our regression model fits the data purely by accident.  Significance F=0.643195730271619=64% > 5%  that means ,there is no significant relationship between our two variables.
INTERPREATION OF REGRESSION OUTPUTS P value P value=0.000253490931854696=0.025% .It indicates high statistical significance of our independent variables individually. It shows how confident we are in your analysis. For a P value to be statistically significant, it has to be;  P value=5%=0.05 P value=1%=0.01 P value=10%=0.10
Recep maz msb 701 quantitative analysis for managers
Recep maz msb 701 quantitative analysis for managers
Recep maz msb 701 quantitative analysis for managers
Recep maz msb 701 quantitative analysis for managers
Recep maz msb 701 quantitative analysis for managers
Recep maz msb 701 quantitative analysis for managers

More Related Content

What's hot

Regression analysis made easy
Regression analysis made easyRegression analysis made easy
Regression analysis made easyWeam Banjar
 
Multicolinearity
MulticolinearityMulticolinearity
MulticolinearityPawan Kawan
 
Multiple Regression and Logistic Regression
Multiple Regression and Logistic RegressionMultiple Regression and Logistic Regression
Multiple Regression and Logistic RegressionKaushik Rajan
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVADerek Kane
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysissomimemon
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1Muhammad Ali
 
Lesson 8 Linear Correlation And Regression
Lesson 8 Linear Correlation And RegressionLesson 8 Linear Correlation And Regression
Lesson 8 Linear Correlation And RegressionSumit Prajapati
 
What is Simple Linear Regression and How Can an Enterprise Use this Technique...
What is Simple Linear Regression and How Can an Enterprise Use this Technique...What is Simple Linear Regression and How Can an Enterprise Use this Technique...
What is Simple Linear Regression and How Can an Enterprise Use this Technique...Smarten Augmented Analytics
 
Introduction to regression analysis 2
Introduction to regression analysis 2Introduction to regression analysis 2
Introduction to regression analysis 2Sibashis Chakraborty
 

What's hot (16)

Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
 
Regression presentation
Regression presentationRegression presentation
Regression presentation
 
Regression analysis made easy
Regression analysis made easyRegression analysis made easy
Regression analysis made easy
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Multiple Regression and Logistic Regression
Multiple Regression and Logistic RegressionMultiple Regression and Logistic Regression
Multiple Regression and Logistic Regression
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVA
 
Multiple linear regression
Multiple linear regressionMultiple linear regression
Multiple linear regression
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysis
 
Path analysis with manifest variables
Path analysis with manifest variablesPath analysis with manifest variables
Path analysis with manifest variables
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1
 
Lesson 8 Linear Correlation And Regression
Lesson 8 Linear Correlation And RegressionLesson 8 Linear Correlation And Regression
Lesson 8 Linear Correlation And Regression
 
Correlation
CorrelationCorrelation
Correlation
 
Logistic regression
  Logistic regression  Logistic regression
Logistic regression
 
What is Simple Linear Regression and How Can an Enterprise Use this Technique...
What is Simple Linear Regression and How Can an Enterprise Use this Technique...What is Simple Linear Regression and How Can an Enterprise Use this Technique...
What is Simple Linear Regression and How Can an Enterprise Use this Technique...
 
Introduction to regression analysis 2
Introduction to regression analysis 2Introduction to regression analysis 2
Introduction to regression analysis 2
 

Similar to Recep maz msb 701 quantitative analysis for managers

ders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptErgin Akalpler
 
A Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxA Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxzeusrex4815162342
 
Introduction-to-Linear-Regression.pptx
Introduction-to-Linear-Regression.pptxIntroduction-to-Linear-Regression.pptx
Introduction-to-Linear-Regression.pptxengdlshadfm
 
Research Methodology Module-06
Research Methodology Module-06Research Methodology Module-06
Research Methodology Module-06Kishor Ade
 
STATISTICAL REGRESSION MODELS
STATISTICAL REGRESSION MODELSSTATISTICAL REGRESSION MODELS
STATISTICAL REGRESSION MODELSAneesa K Ayoob
 
Applications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipApplications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipRithish Kumar
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression AnalysisSalim Azad
 
How to Interpret your regression output in management PhD research .pdf
How to Interpret your regression output in management PhD research .pdfHow to Interpret your regression output in management PhD research .pdf
How to Interpret your regression output in management PhD research .pdfphdassistance101
 
PPT Correlation.pptx
PPT Correlation.pptxPPT Correlation.pptx
PPT Correlation.pptxMahamZeeshan5
 
Multiple regression by anagha singh
Multiple regression by anagha singhMultiple regression by anagha singh
Multiple regression by anagha singhAnaghaSingh
 
My regression lecture mk3 (uploaded to web ct)
My regression lecture   mk3 (uploaded to web ct)My regression lecture   mk3 (uploaded to web ct)
My regression lecture mk3 (uploaded to web ct)chrisstiff
 

Similar to Recep maz msb 701 quantitative analysis for managers (20)

ders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.ppt
 
A Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxA Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptx
 
Introduction-to-Linear-Regression.pptx
Introduction-to-Linear-Regression.pptxIntroduction-to-Linear-Regression.pptx
Introduction-to-Linear-Regression.pptx
 
Multiple Linear Regression
Multiple Linear Regression Multiple Linear Regression
Multiple Linear Regression
 
Research Methodology Module-06
Research Methodology Module-06Research Methodology Module-06
Research Methodology Module-06
 
STATISTICAL REGRESSION MODELS
STATISTICAL REGRESSION MODELSSTATISTICAL REGRESSION MODELS
STATISTICAL REGRESSION MODELS
 
Quantitative Methods - Level II - CFA Program
Quantitative Methods - Level II - CFA ProgramQuantitative Methods - Level II - CFA Program
Quantitative Methods - Level II - CFA Program
 
Ders 2 ols .ppt
Ders 2 ols .pptDers 2 ols .ppt
Ders 2 ols .ppt
 
CH3.pdf
CH3.pdfCH3.pdf
CH3.pdf
 
Applications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipApplications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationship
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysis
 
Simple Regression.pptx
Simple Regression.pptxSimple Regression.pptx
Simple Regression.pptx
 
How to Interpret your regression output in management PhD research .pdf
How to Interpret your regression output in management PhD research .pdfHow to Interpret your regression output in management PhD research .pdf
How to Interpret your regression output in management PhD research .pdf
 
Measure of Association
Measure of AssociationMeasure of Association
Measure of Association
 
PPT Correlation.pptx
PPT Correlation.pptxPPT Correlation.pptx
PPT Correlation.pptx
 
regression.ppt
regression.pptregression.ppt
regression.ppt
 
Multiple regression by anagha singh
Multiple regression by anagha singhMultiple regression by anagha singh
Multiple regression by anagha singh
 
My regression lecture mk3 (uploaded to web ct)
My regression lecture   mk3 (uploaded to web ct)My regression lecture   mk3 (uploaded to web ct)
My regression lecture mk3 (uploaded to web ct)
 
Statistical analysis in SPSS_
Statistical analysis in SPSS_ Statistical analysis in SPSS_
Statistical analysis in SPSS_
 
2-20-04.ppt
2-20-04.ppt2-20-04.ppt
2-20-04.ppt
 

Recently uploaded

Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 

Recently uploaded (20)

Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 

Recep maz msb 701 quantitative analysis for managers

  • 1. Quantitative Analysis for Managers Regression analysis application Instructor: Prof. MINE AYSEN DOYRAN Student: RecepMaz
  • 2. Regression analysis Regression analysis includes any techniques for modeling and analyzing several variables, when the focus is on the relationship between a dependent variable and one or more independent variables. Regression analysis helps one understand how the typical value of the dependent variable changes when any one of the independent variables is varied, while the other independent variables are held fixed. Regression analysis estimates the conditional expectation of the dependent variable given the independent variables — that is, the average value of the dependent variable when the independent variables are held fixed.
  • 3. Regression analysis The focus is on a quantile, or other location parameter of the conditional distribution of the dependent variable given the independent variables. In all cases, the estimation target is a function of the independent variables called the regression function. In regression analysis, it is also of interest to characterize the variation of the dependent variable around the regression function, which can be described by a probability distribution.
  • 4. Regression analysis Regression analysis is widely used for prediction and forecasting, where its use has substantial overlap with the field of machine learning. Regression analysis is also used to understand which among the independent variables are related to the dependent variable, and to explore the forms of these relationships.
  • 5. Regression analysis In restricted circumstances, regression analysis can be used to infer causal relationships between the independent and dependent variables. Simple linear regression models have only two variables Multiple regression models have more variables
  • 6. Regression models involve the following variables The variable to be predicted is called the dependent variable, Y Sometimes called the response variable The value of this variable depends on the value of the independent variable, X Sometimes called the explanatory or predictor variable, control variable A regression model relates Y to a function of X
  • 7. Independent variable Independent variable Dependent variable = + Introduction regression models dependent variable, Y independent variable, X A regression model relates Y to a function of X
  • 8. Testing the Model for Significance If the F-statistic is large, the significance level (P-value) will be low, indicating it is unlikely this would have occurred by chance If P value of F Statistic (Significance F) is smaller than 0.05 (5%), it means that your regression model is statistically significant.
  • 9. Testing the Model for Significance The best model is a statistically significant model with a high r2 and few variables As more variables are added to the model, the r2-value usually increases For this reason, the adjusted r2 value is often used to determine the usefulness of an additional variable The adjusted r2 takes into account the number of independent variables in the model
  • 10. Testing the Model for Significance  As the number of variables increases, the adjusted r2 gets smaller unless the increase due to the new variable is large enough to offset the change in k (number of independent variables)
  • 11. Testing the Model for Significance   In general, if a new variable increases the adjusted r2, it should probably be included in the model In some cases, variables contain duplicate information When two independent variables are correlated, they are said to be collinear When more than two independent variables are correlated, multicollinearity exists When multicollinearity is present, hypothesis tests for the individual coefficients are not valid but the model may still be useful
  • 12. Hypothesis statement , dependent variable and independent variable Dependent variable……: Total number of white people between 18 to 64 years Independent variable…: Number of white people below poverty level between 18 to 64 years Hypothesis statement..: Hypothesis statement is that while population of white adult people (18 to 64 years) increases, number of white people between 18 to 64 years who are living below poverty level decrease by the years.
  • 13. INTERPREATION OF REGRESSION OUTPUTS R Square R square= 0.024884311=2.5% of variation in total number of white people between 18 to 64 years is explained by white people below poverty level . This value is indicating weak fitness. I f R square is too high (0,8/0,9…) we will have multicollinearity problem. Which means our variables correlated each other. Fortunately, our R square value is not too high and it is also between 0 and 1.
  • 14. INTERPREATION OF REGRESSION OUTPUTS Adjusted R square Adjusted R Square= -0.0834618768434626=-8.3% this value is indicating weak fitness. If the number of observations is small we may obtain a higher value of r square. This can provide a very misleading indicator of goodness of fit. That is why many researchers use adjusted R square value instead. If the adjusted R square value higher than R square value we may face multicollinearity problem. Adjusted R Square=-8.3% < R square=2.5% . We don’t have multicollinearity problem.
  • 15. INTERPREATION OF REGRESSION OUTPUTS Significance F The most important indicator to analysis regression outputs significance F. This value refers statical significant of regression model. This value provides evidence of existence of a linear relationship between our two variables. It also provides a measure of the total variation explained by the regression relative to the total unexplained variation. The higher the significance F, the better the overall fit of the regression line. Significance F values of 5% (0.05) or less are generally considered statistically significant. Like P values, lower the significant of the value, the more confident we can be of the overall significance of the regression equation. Interpretation of Significance F is the low number means there is only 64% chance that our regression model fits the data purely by accident. Significance F=0.643195730271619=64% > 5% that means ,there is no significant relationship between our two variables.
  • 16. INTERPREATION OF REGRESSION OUTPUTS P value P value=0.000253490931854696=0.025% .It indicates high statistical significance of our independent variables individually. It shows how confident we are in your analysis. For a P value to be statistically significant, it has to be; P value=5%=0.05 P value=1%=0.01 P value=10%=0.10